#7 SimCLRv2 - Big Self-Supervised Models are Strong Semi-Supervised Learners
Date:
This paper introduces SimCLRv2 and shows that semi-supervised learning is strongly benefited by self-supervised pre-training. Stunningly it shows that bigger models yield larger gains when fine-tuning with fewer labelled examples. Link for the video